Skip to content

Conversation

@zxdukki
Copy link
Contributor

@zxdukki zxdukki commented Jun 18, 2025

What this PR does / why we need it?

Fix env variable in dbo to enable dbo in DeepSeek-V3 model. Besides, we have fixed an known issue in deepseek-dbo.

Does this PR introduce any user-facing change?

How was this patch tested?

This patch can be tested with newly added e2e tests: tests/multicard/test_offline_inference_distributed.py.
We checked the registered module name and class name in these tests.

Signed-off-by: zhuohuan <zxdu1997@gmail.com>
@zxdukki zxdukki force-pushed the dev-v0.9.1-dbo-init-fix branch from 9086efe to 44b5917 Compare June 18, 2025 11:59
@wangxiyuan wangxiyuan changed the title [Bugfix]: fix env variables for deepseek dbo [0.9.1][Bugfix]: fix env variables for deepseek dbo Jun 18, 2025
Signed-off-by: zhuohuan <zxdu1997@gmail.com>
zxdukki added 2 commits June 19, 2025 10:34
Signed-off-by: zhuohuan <zxdu1997@gmail.com>
Signed-off-by: zhuohuan <zxdu1997@gmail.com>
@wangxiyuan wangxiyuan merged commit 6a3551e into vllm-project:v0.9.1-dev Jun 19, 2025
16 checks passed
@Yikun Yikun added the no-main label Jul 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants